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Voice Site Personality Setting 

Field of the Invention 

5 The present invention relates to the setting of the voice personality of a voice service site. 
Background of the Invention 

In recent years there has been an explosion in the number of services available over the 
World Wide Web on the public internet (generally referred to as the "web"), the web being 
1 0 composed of a myriad of pages linked together by hyperlinks and delivered by servers on 
request using the HTTP protocol. Each page comprises content marked up with tags to 
enable the receiving application (typically a GUI browser) to render the page content in the 
manner intended by the page author; the markup language used for standard web pages is 
HTML (HyperText Markup Language). 

15 

However, today far more people have access to a telephone than have access to a computer 
with an Internet connection. Sales of cellphones are outstripping PC sales so that many 
people have already or soon will have aphone within reach where ever they go. As aresult, 
there is increasing interest in being able to access web-based services from phones. 'Voice 
20 Browsers' offer the promise of allowing everyone to access web-based services from any 
phone, making it practical to access the Web any time and any where, whether at home, on 
the move, or at work. 

Voice browsers allow people to access the Web using speech synthesis, pre-recorded 
25 audio, and speech recognition. Figure 1 of the accompanying drawings illustrates the 
general role played by a voice browser. As can be seen, a voice browser is interposed 
between a user 2 and a voice page server 4. This server 4 holds voice service pages (text 
pages) that are marked-up with tags of a voice-related markup language (or languages). 
When a page is requested by the user 2, it is interpreted at a top level (dialog level) by a 
30 dialog manager 7 of the voice browser 3 and output intended for the user is passed in text 
form to a Text-To-Speech (TTS) converter 6 which provides appropriate voice output to 
the user. User voice input is converted to text by speech recognition module 5 of the voice 



2 

browser 3 and the dialog manager 7 determines what action is to be taken according to the 
received input and the directions in the original page. The voice input / output interface 
can be supplemented by keypads and small displays. 

5 In general terms, therefore, a voice browser can be considered as a largely software device 
which interprets a voice markup language and generate a dialog with voice output, and 
possibly other output modalities, and / or voice input, and possibly other modalities (this 
definition derives from a working draft, dated September 2000, of the Voice browser 
Working Group of the World Wide Web Consortium). 

10 

Voice browsers may also be used together with graphical displays, keyboards, and pointing 
devices (e.g. a mouse) in order to produce a rich "multimodal voice browser". Voice 
interfaces and the keyboard, pointing device and display maybe used as alternate interfaces 
to the same service or could be seen as being used together to give a rich interface using all 
15 these modes combined. 

Some examples of devices that allow multimodal interactions could be multimedia PC, or 
a communication appliance incorporating a display, keyboard, microphone and 
speaker/headset, an in car Voice Browser might have display and speech interfaces that 
20 could work together, or a Kiosk. 

Some services may use all the modes together to provide an enhanced user experience, for 
example, a user could touch a street map displayed on a touch sensitive display and say 
"Tell me how I get here?". Some services might offer alternate interfaces allowing the user 
25 flexibility when doing different activities. For example while driving speech could be used 
to access services, but a passenger might used the keyboard. 

Figure 2 of the accompanying drawings shows in greater detail the components of an 
30 example voice browser for handling voice pages 15 marked up with tags related to four 
different voice markup languages, namely: 

- tags of a dialog markup language that serves to specify voice dialog behaviour; 
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- tags of a multimodal markup language that extends the dialog markup language 
to support other input modes (keyboard, mouse, etc.) and output modes (large 
and small screens); 

- tags of a speech grammar markup language that serve to specify the grammar of 
5 user input; and 

- tags of a speech synthesis markup language that serve to specify voice 
characteristics, types of sentences, word emphasis, etc. 



When a page 1 5 is loaded into the voice browser, dialog manager 7 determines from the 
10 dialog tags and multimodal tags what actions are to be taken (the dialog manager being 
programmed to understand both the dialog and multimodal languages 19). These actions 
may include auxiliary functions 18 (available at any time during page processing) 
accessible through APIs and including such things as database lookups, user identity and 
validation, telephone call control etc. When speech output to the user is called for, the 
15 semantics of the output is passed, with any associated speech synthesis tags, to output 
channel 12 where a language generator 23 produces the final text to be rendered into 
speech by text-to-speech converter 6 and output to speaker 17. In the simplest case, the text 
to be rendered into speech is fully specified in the voice page 15 and the language 
generator 23 is not required for generating the final output text; however, in more complex 
20 cases, only semantic elements are passed, embedded in tags of a natural language 
semantics markup language (not depicted in Figure 2) that is understood by the language 
generator. The TTS converter 6 takes account of the speech synthesis tags when effecting 
text to speech conversion for which purpose it is cognisant of the speech synthesis markup 
language 25. 

25 

The way the synthesized voice sounds (which is referred to herein as the 'voice 
personality' since the synthesized voice can be made to imitate a particular person) 
depends on an implicit or explicit set of characterisers 30 of the process used for voice 
synthesis. Thus, if the voice output is synthesised using a voie tract model, then the 
3 0 characterisers setting the voice personality are the parameters of the model; alternatively, if 
the voice output is synthesised by the concatenation of digitised voice elements such as 
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phonemes, allophones, diphones or the like, then these elements (which may have been 
derived from a particular celebrity) constitute the characterisers of the voice personality. 



User voice input is received by microphone 1 6 and supplied to an input channel of the 
5 voice browser. Speech recogniser 5 generates text which is fed to a language understanding 
module 21 to produce semantics of the input for passing to the dialog manager 7. The 
speech recogniser 5 and language understanding module 21 work according to specific 
lexicon and grammar markup language 22 and, of course, take account of any grammar 
tags related to the current input that appear in page 15. The semantic output to the dialog 
10 manager 7 may simply be a permitted input word or may be more complex and include 
^ embedded tags of a natural language semantics markup language. The dialog manager 7 

~zz determines what action to take next (including, for example, fetching another page) based 

D on the received user input and the dialog tags in the current page 15. 



1 5 Any multimodal tags in the voice page 1 5 are used to control and interpret multimodal 
input/output. Such input/output is enabled by an appropriate recogniser 27 in the input 
channel 1 1 and an appropriate output constructor 28 in the output channel 12. 

Whatever its precise form, the voice browser can be located at any point between the user 
20 and the voice page server. Figures 3 to 5 illustrate three possibilities in the case where the 
voice browser functionality is kept all together; many other possibilities exist when the 
functional components of the voice browser are separated and located in different 
logical/physical locations. 

25 In Figure 3 , the voice browser 3 is depicted as incorporated into an end-user system 8 (such 
as a PC or mobile entity) associated with user 2. In this case, the voice page server 4 is 
connected to the voice browser 3 by any suitable data-capable bearer service extending 
across one or more networks 9 that serve to provide connectivity between server 4 and end- 
user system 8. The data-capable bearer service is only required to carry text-based pages 

30 and therefore does not require a high bandwidth. 
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Figure 4 shows the voice browser 3 as co-located with the voice page server 4. In this case, 
voice input/output is passed across a voice network 9 between the end-user system 8 and 
the voice browser 3 at the voice page server site. The fact that the voice service is 
embodied as voice pages interpreted by a voice browser is not apparent to the user or 
5 network and the service could be implemented in other ways without the user or network 
being aware. 

In Figure 5, the voice browser 3 is located in the network infrastructure between the end- 
user system 8 and the voice page server 4, voice input and output passing between the end- 
1 0 user system and voice browser over one network leg, and voice-page text data passing 

O between the voice page server 4 and voice browser 3 over another network leg. This 

q arrangement has certain advantages ; in particular, by locating expensive resources (speech 

recognition, TTS converter) in the network, they can be used for many different users with 

□ user profiles being used to customise the voice-browser service provided to each user. 

T 15 

•IT; Voice-based services are highly attractive because of their ease of use. However, the 

O reaction of users to different voice output personalities can vary widely - one voice 

O personality can encourage a certain class of users whilst alienating a different class. 

20 It is an object of the present invention to provide a method and apparatus by which voice 
services can be presented to users with voice personalities with which the user is 
comfortable. 



25 Summary of the Invention 

According to one aspect of the present invention, there is provided a method of setting the 
voice personality of a voice service site, wherein the voice personality characterisers 
associated with a previously-visited voice service site are used in presenting the voice 
output of a currently- visited voice service site. 

30 

Typically, the voice service sites operate by serving, from voice page servers, voice pages 
in the form of text with embedded voice markup tags to a voice browser, the voice browser 
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interpreting these pages and carrying out speech recognition of user voice input, text to 
speech conversion to generate voice output, and dialog management; the voice browser 
being disposed between voice page servers and the user. In this case, it is the browser that 
manages which set of voice personality characterisers is used in rendering a particular 
5 voice page. 

The voice personality characterisers preferably have associated usage permissions 
regarding what sites can use the characterisers. Voice service sites may also specify 
whether external voice personality characterisers can be used for presenting the voice 
10 output of the site. 

According to another aspect of the present invention, there is provided apparatus 
comprising: 

- voice-service access means for accessing different voice service sites; 

15 - voice-service presentation means for presenting the output from an accessed voice 
service site using a voice set by a selected set of voice personality characterisers; and 

- selection means for selecting the set of voice personality characterisers to be used by 
the voice-service presentation means to present the currently accessed site, the 
selection means being operative to enable a set of voice personality characterisers 

20 associated with a previously-accessed voice service site to be selected for use in 
presenting a currently- visited voice service site. 

According to a further aspect of the present invention, there is provided a server site 
holding sets of voice personality characterisers for imparting particular voice personalities 
25 to the presentation of the output of voice service sites, said sets having associated usage 
permissions regarding use of the sets in presenting voice sites. 

Brief Description of the Drawings 

30 A method and apparatus embodying the invention will now be described, by way of non- 
limiting example, with reference to the accompanying diagrammatic drawings, in which: 
. Figure 1 is a diagram illustrating the role of a voice browser; 
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. Figure 2 is a diagram showing the functional elements of a voice browser and their 

relationship to different types of voice markup tags; 
. Figure 3 is a diagram showing a voice service implemented with voice browser 

functionality located in an end-user system; 
5 . Figure 4 is a diagram showing a voice service implemented with voice browser 

functionality co-located with a voice page server; 
. Figure 5 is a diagram showing a voice service implemented with voice browser 

functionality located in a network between the end-user system and voice 

page server; and 

Figure 6 is a diagram of an embodiment of the invention in which the same voice 
personality is used by two different voice services. 

Best Mode of Carrying Out the Invention 

In the following description, voice services are described based on voice page servers 
serving pages with embedded voice markup tags to voice browsers. Unless otherwise 
indicated, the foregoing description of voice browsers, and their possible locations and 
access methods is to be taken as applying also to the described embodiments of the 
invention. Furthermore, although voice-browser based forms of voice services are 
preferred, the present invention in its widest conception, is not limited to these forms of 
voice service system and other suitable systems will be apparent to persons skilled in the 
art. 

In Figure 6, a user 2 is depicted as using equipment 8 to browse a voice web, represented 
25 by voice page servers 4A and 4B, with the aid of a voice browser 3 located in the 
communications infrastructure 9 (though it maybe located anywhere for present purposes). 

The voice browser 3 includes a selector 33 for selecting between available sets of voice 
personality characteristics (abbreviated to ' VPC below) 30, the selected set being supplied 
30 to the text-to-speech converter 6 (Figure 2) of the browser to condition the voice output of 
the page currently being processed by the browser. The selected VPC set imparts, for 
example, a celebrity voice personality to the page output. Figure 6 shows four VPC sets, 
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namely: a default VPC set 30D held by the browser and used when no other VPC set is 
available or desired (the default VPC set can be one specified by the user 2); a respective 
VPC set 30X and 30Y associated with voice page servers 4A and 4B; and an independent 
VPC set 30Z hosted on a third party server 3 1 . 

5 

When voice browser 3 receives a voice page for interpretation, the VPC selector 33 checks 
to see if the page specifies the use of any particular VPC set; if it does not then the default 
VPC set 30D is selected. If a particular VPC set is specified then VPC selector, possibly 
after confirming with the user, retrieves the specified VPC set to store 34 and notifies the 
1 0 TTS converter 6 that it should use this VPC set in rendering the page. 

Thus, with reference to the Figure 6 example, user 2 browses to voice page 40 which is 
served by server 4 A to the voice browser 3. The head portion of page 40 includes a link 
line 41 identifying VPC set 30X as the one to be used (this link includes the URL of the 
1 5 set). VPC selector 33 recognises this reference and selects the corresponding VPC set 30X 
over the default VPC set 30D (see decision circle 50 in Figure 6). VPC set 30X is then 
retrieved from server 4A and saved to the store 34 from where it is used by TTS converter 
6 in preference to the default VPC set 30D. 

20 In due course, the user activates a hyperlink 42 on page 40 to fetch a page 44 from voice 
page server 4B. This page 44 has a VPC link 45 in its head portion that references VPC set 
30Y. However, the hyperlink 42 on page 40 includes an attribute which indicates that the 
VPC set 3 OX can also be used with page 44. The VPC selector 33 takes note of this and is 
therefore required to select between VPC set 30X and VPC set 30Y on reading the link 45 

25 in page 44. The selection (see decision circle 55) can be effected by consulting the user, or 
by automatically favouring the VPC specified in the calling page 40 or the called page 44. 
In the present case, it is assumed that the VPC set 30X is selected so that the output from 
voice page 44 is now rendered with the same voice personality as was used for voice page 
40. The permission given by the attribute in hyperlink 42 for the use of VPC set 3 OX in 

30 respect of page 44 is treated as being specific to that page (and possibly other pages on the 
same site) so when the user hyperlinks from page 44 to a yet further page on a different 
server (not shown), the option of using VPC set 30X ceases to be available to selector 33. 
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An example scenario showing the benefits of using the foregoing mechanism will now be 
given. Imagine that the user 2 is browsing the voice site (on server 40 A) of a well known 
celebrity cookery chef to find a receipt for an evening meal. The feel of the voice site is 
5 familiar to the user from the television program hosted by the celebrity, containing many 
familiar background cookery sounds and noises. The voice output of the site (effectively 
the site "host") is presented in the voice of the celebrity, this being the voice personality 
represented by VPC set 30X. User 2 can interact with the 'host', querying receipts, 
ingredients and cooking methods. 

10 

At some point during user's visit to the voice site, the user decides to buy the list of 
ingredients for a chosen dish. The 'host' recommends a well known shopping store, where 
it just so happens there is a series of special offers to all visitors from the celebrity's 
cookery voice site. 

15 

User 2 chooses to visit to the shopping store, by voice hyper-linking (hyperlink 42) to the 
shop's voice site (on server 40B), and requests the celebrity chef to accompany them 
through the shop. During this visit to the shop's voice site, the user hears all the distinctive 
sounds of the particular shop, as well as the voice of the celebrity (VPC set 30X is still 
20 being used) suggesting ingredients and other items the user may like to buy. On 
successfully purchasing the desired goods, the user asks the celebrity to take the user back 
to the original voice site and help the user in cooking the meal. 

At any time during the user's visit to the store site, the user is given the option of saying 
25 goodbye to the celebrity host in and, instead, to be guided by the shop's assistant; in this 
case, the VPC selector retrieves VPC set 30Y, saves it to store 34, and instructs the TTS 
converter to use set 30Y for further speech output from server 40B. 

The foregoing arrangement offers the user the advantages of a familiar voice to guide and 
30 recommend products or services, and the resultant reassurance is of benefit both the the 
user and the store. 
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Since voice personalities, particularly of celebrities, have value but can also be misleading 
if wrongly used, it is useful to provide for a variety of mechanisms for ensuring proper use 
of the VPC sets when the latter are retrievable by voice browsers independently of the 
pages with which they are intended to be used. Thus, for example: 
5 (a) - each VPC set can have associated permissions specifying what pages it can be used 

with (including, possibly, a generic page provided it is accompanied by an 

authorisation accepted by the VPC set); 
(b) - a page can have associated permissions that mandates or permits the use of a 

particular VPC set or a VPC set selected from a category of VPC sets; 
10 (c) - a page can have associated permissions that mandate that a particular VPC set of 

class of VPC set is NOT used (this could be done if either a particular VPC set is 

only suggested or no set is proposed at all); 
(d) - a hyperlink in a page can have associated permissions similar to permissions in (b) 

and/or (c). 

15 It is the role of the VPC selector to determine what VPC set or sets can be used having 
regard to all the permissions associated with the VPC sets, calling page and called page. 
Regardless of the stated permissions, the VPC selector 33 always has the right to choose 
the default VPC set 30D of the browser. 

20 

Many other variants are, of course, possible to the arrangement described above with 
reference to Figure 6. For example, a voice site can opt to use a VPC set 30Z provided by a 
third-party server 3 1 assuming that this is permitted by the party controlling use of the set 
30Z. 

25 

Furthermore, each set of voice personality characterisers can have respective associated 
phrasing style data specifying a particular sentential speaking style matching the voice 
personality. The phrasing style data is retrieved by the voice browser when retrieving the 
corresponding set of voice personality characterisers, and is used to control the text 
30 generated by language generator 23 (see Figure 2) when expressing the semantic meaning 
specified in a current voice page. 



